Papers with logical reasoning abilities
Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive human-like performance across various reasoning tasks, but their mastery of underlying inferential rules falls short of human capabilities. |
| Approach: | They propose a logic scaffolding inferential rule generation framework to construct an infer- ential rule base, ULogic, comprising both primitive and compositional rules across five domains. |
| Outcome: | The proposed model improves the ability to generate accurate, complex and abstract conclusions and premises and improves various commonsense reasoning tasks. |